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ABSTRACT 
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special test instructions. The paper-and“penc i 1 test (PPT) and the 
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or CAT-PPT) under the counterbalanced design at the computer 
laboratory. They were also given a 10“item paper test anxiety scale, 
a 10-item covnputer test anxiety scale, and a paper-and-penci 1 version 
of thf; Quest ionnaire on Computerized Adaptive Testing. A multivariate 
analysis of covariance, with the math aptitude and the test anxiety 
as covariates, demonstrated that test motivation influenced 
improvement in estimated ability and reduction in test anxiety, but 
did not affect CAT attitudes. (Contains 4 tables and 45 references.) 
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Abstract 



The purpose of the study was to investigate the effects of test motivation on estimated 
ability, test anxiety, and attitudes toward computerized adaptive testing (CAT). Korean 
college students (n = 208) were given the Math Aptitude Test, Math Self-Concept Scale, Math 
Test Anxiety Scale, Computer Competence Instrument, Computer Anxiety Scale, and Test 
Anxiety Inventory in the regular classroom. The two groups (Motivated and Non-motivated) 
were randomly assigned by each course section. The motivated group was given special test 
instructions. The paper-and-pencil test (PPT) and the CAT algebra tests were given to each 
group in random order (PFl -CAT or CAT-PPT) under the counterbalanced design at the 
computer laboratory. They were also given a 10-item paper test anxiety scale, a 10-item 
computer test anxiety scale, and a paper-and-pencil version of the Questionnaire on 
^otnputerized Adaptive Testing. A multivariate analvsis of covariance, with the math 
aptitude and the test anxiety as covariates, demonstrated that test motivation influenced 
improvement in estimated ability and reduction in test anxiety, but did not affect CAT 
attitudes. 
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The Influence of Examinee Test-Taking Motivation 
in Computerized Adaptive Testing* 



1 



Computerized adaptive testing (CAT) has several advantages over conventional paper- 
and-pencil testing (PPT). Most CAT studies have tried to demonstrate the efficiency and 
precision of the examinee's ability estimation in CAT over PPl (Bergstrom & Lunz, 1992; 
Betz Sc Weiss, 1973, 1974; Frick, 1989, 1990; Kingsbury, 1990; McBride Sc Martin, 1983; 
McKinley Sc Reckase, 1980; Olsen, Maynes, Slawson, Sc Ho, 1989; Weiss, 1982). However, 
research on the effects of demographic and psychological characteristics of examinees on CAT 
has been largely neglected (Legg Sc Buhr, 1992; ICim, 1993). In other words, how examinees' 
individual differences are systematically related to CAT methods has not been studied 
extensively. 

Recently, a few researchers have paid attention to individual differences in CATs (Legg 
Sc Buhr, 1992; Rocklin Sc O'Donnell, 1987; Vispoel Sc Rocklin, 1993). Their studies 
investigated the effects of several individual difference variables (age, ability, computer 
anxiety, computer experience, gender, math self-concept, and test anxiety) on test 
performance. They also explored whether group differences in reactions to computerized test 
administration could help explain observed differences between CAT and PPT (Legg Sc Buhr, 
1992), between computerized test (CT) and self-adapted test (Rocklin Sc O'Donnell, 1987), 
and among CT, CAT, and self-adapted testing (Vispoel Sc Rocklin, 1993). Previous studies 
demonstrated the efficiency and precision of CAT, but showed inconclusive results with 
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* The authors wish to thank Drs. Steven L. Wise and Barbara S. Plake who allowed us 
to use a set of algebra skills items they developed for use in another study. 



respect to specific individual difference variables and the relationships between individual 
difference variables and test performance. 

Few studies have compared individual differences in student test-taking motivation 
between PPT and CAT. Generally, researchers use many kinds of rewards to motivate 
students to pay attention to their tasks, to use their full abilities, and to enlist their best 
efforts in doing their work. Student test-taking motivation is a possible factor in the 
performance of students on nearly all standardized achievement tests (Brown &. Walberg, 
1993), large-scale state-constructed achievement tests (Linn, 1993; Wolf, 1993; Wolf, Smith, 
Sc Birnbaum, 1994), and international achievement tests (Wainer, 1993). The content of 
those tests is often unrelated to specific topics that students have recently studied, and their 
performance on such tests does not affect their grades. Wainer (1993) has argued that the 
outstanding performance of Korean students in two international comparative studies may be 
due to their high student test-taking motivation because the chosen students are representing 
the honor of their school and their country in this competition. 

Brovm and Walberg (1993) found the motivational effects on test scores of elementary 
students, using special test instruction enhanced their test-taking motivation. Wolf (1993) 
found that motivation to perform on a test is directly influenced by the consequence of the 
level of performance, and that motivation to perform enhances test performance. Wolf, et al. 
(1994) proposed an extension of Pintrich's e.xpectancy theory of motivation (Pintrich, 1988, 
1989) in which the e.xpectancy component includes not only the individual's assessment of 
how likely he or she is to do well on an item, but also how much work will be involved in the 
completion of the item. They also found that an item that required much time required more 
motivation to put forth the mental energy necessary to arrive at a correct answer. IGm (1995) 
found that e.xaminees' test motivation is a significant predictor relating to computerized 
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adaptive test performance. Therefore, we can say that examinees' test motivation is associated 
with higher level of test performance on both PPTs and CATs. 

Previous research on the relationship between test anxiety and achievement motivation 
offered a variety of interpretation (Atidnson, 1964; Hill, 1972, 1980; Sarason, Davidson, 
Lighthall, Waite, & Ruebush, 1960). Hill (1972) combined elements of both the Sarason 
theory of anxiety and the Atkinson approach to achievement motivation. Hill's 
conceptualization agrees with Sarason's theory in that evaluative reactions from adults are 
believed to underlie and enhance the effects of success/failure experiences. It also utilizes 
Atkinson's theory of emphasizing motives to approach success and avoid failure and trying to 
delineate the absolute strength of the two motives (Phillips, Pitcher, Worshman, & Miller, 
1980). McMillan (1980) explained that success is usually associated with a positive affect 
that alleviates anxiety, whereas failure tends to elicit a negative feeling that increases anxiety. 
Mevarecb and Ben-Artzi (1987) demonstrated that computer-assisted instruction (CAI) as 
compared to traditional instruction tends to yield lower scores on various aspects of 
mathematics anxiety. According to Mevarech and Ben-Artzi (1987), the high rate of 
success/failure provided in CAI settings contributed to lower levels of worries about learning 
mathematics. Like CAI settings, we may expect a lower level of test anxiety in CAT settings 
than in PPT conditions because the rate of success/failure is usvially not controlled. If 
examinees' test motivation is associated with higher levels of test performance in CAT test 
situations, examinees may have a higher rate of success and sufficient motivation to alleviate 
anxiety. It is worthwhile to investigate the effects of test motivation not only on test 
performance but also on test anxiety and attitudes in CAT test conditions. 
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The purpose of this study was to examine the effects of examinees' test-taking 
motivation on estimated ability, test anxiety, and attitude toward computerized adaptive 
testing to identify the feasibility of the CAT in college classroom testing. 

Method 

Subjects and Treatments 

The subjects in this study were a sample of 208 Korean college students enrolled in 
Test Sc Measurements courses at the Kyungpook National University, Taegu, Korea. Data 
were collected from six course sections during the spring semester of 1994. 

Two treatments, the test method and student test-taking motivation level, were used as 
independent variables in this study. The paper-and-pencil test (PPT) method was a designed 
test of 20 items selected from a pool of 70 algebra items (Wise, Plake, Johnson, Sc Roos, 
1992). The computerized adaptive test (CAT) method used a pool of 70 algebra items. The 
adaptive test terminated when 20 items were administered or when the variance of .10 was 
reached (Legg Sc Buhr, ' 992), whichever come first. 

The motivated subject group was given special test instructions that indicated the test 
was very important because it \\ as helpful to learn concepts of basic statistics, they would 
receive extra points, and results would be used to compare Korean college students with their 
American counterparts. The non-motivated group was given only the standard test 
instructions. 

Instruments 

Algebra Item Bank . A pool of items was developed to be used in identifying those 
introductory statistics students whose basic mathematics skills were in need of remediation 
(Wise, et al., 1992). After reviewing the 90 algebra test items, the authors of the current 
study found that 70 items could apply to Korean students without translation. The feedback 
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statements that are usually a part of CAT were deleted to make the test conditions as equal as 
possible with those for the PPT. The CAT algebra test was administered on IBM 
microcomputers using the MicroCAT Testing System (Assessment Systems Corporation, 
1989). 

Math Aptitude Test . A math aptitude test was used in this study. The test consisted 
of 20 retired Graduate Recoro Examination items. The two Korean mathematics professors 
and the senior author chose five items in each of four subscales. Each item used a five-option, 
multiple-choice format. The test was translated into Korean by the first author. Once the 
Korean version had been prepared, the two Korean mathematics professors were asked to 
check the .est items and compare the Korean version to the English version. 

Computer Competence Instrument . The Computer Competence Instrument, 
developed by Martinez and Mead (1988), was used to measure test takers' computer 
vocabulary and their knowledge about computers. The instrument consisted of 33 four-choice 
items. 




Computer Anxiety Scale . The computer anxiety subscale from the Computer Attitude 
Scale (Loyd ScGressard, 1984) was used to measure computer anxiety. The subscale had 10 
four-option agree-disagree items. The range of the alpha reliabilities in the 10 previous 
studies was from .57 to ,93, and the median was .87 (Kim, McLean, ScMoon, 1994). 

Test Anxiety Inventory . The original Test Anxiety Inventory (TAI; Spielberger, 1980) 
was used to measure general test anxiety one week before e.xaminees took the algebra skills 
test. The modified TAI was used to measure paper and computer test anxiety after taking 
PPT and after taking CAT. The original TAI scale consisted of 20 four-option Likert-tvpe 
items (l=almost never, 4 -almost always). The general test anxiety scale used the original 20 
items, but the paper test anxiety scale changed the word "test" into "paper-and-pencil test." 

s 
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The computer test anxiety scale changed the word "test" into "computer adaptive test." The 
paper and computer test anxiety scales chose and used 10 of the original 20 items that 
specifically asked how test-takers felt during test administration. The 10 items were used to 
measure computer test anxiety (Powell, 1991). The range of possible scores for the modified 
TAI scale varied from a minimum of 10 to a maximum of 40. 

Questionnaire on Computerized Adaptive Testing . A questionnaire was used to assess 
attitudes toward computerized adaptive tests. The questionnaire was designed to identify the 
examinees’ opinions about computerized adaptive testing. The scale consisted of 20 items 
and was a four-point Likert-type measure. Ten items were chosen from the Questionnaire on 
Computer-Assisted Testing (Legg Sc. Buhr, 1992) and five items were modified from the 
Evaluation Questionnaire (Schmidt, Urry, Sc. Gugel, 1978). Five items were added by the 
authors. A principal component analysis of the Attitudes toward Computerized Adaptive 
Testing Questionnaire was conducted, followed by a factor analysis using a two-factor solution 
with a varimax rotation. The first factor item loadings were related to general characteristics 
of computerized testing and suggested G-factor CAT attitudes. The second factor item 
loadings were related to specific characteristics of computerized adaptive testing to compare 
those of paper-and-pencil testing, and suggested S-factor CAT attitudes. 

The translation of the instruments into Korean . All of the instruments, e.xcept the 
Math Aptitude Test, were translated into Korean using the same procedures. The first author 
translated into Korean; every attempt was made to provide a Korean version that was as 
faithful a representation of the English as possible. The Korean versions of the instruments 
were translated back into English by a Korean linguist, and the back-translated versions were 
compared with the original English to ensure that the translation was accurate. A Korean 
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educational psychologist and the author checked the Korean and the back-translated English 
versions of the instruments and compared them to the original English versions. 

Procedures 

The students took the four instruments (Math Aptitude Test, Computer Competence 
Instrument, Test Anxiety Inventory, and Computer Anxiety Scale) under the supervision of 
their instructors in the first week of class. Instruments were assembled into packets and 
distributed in a random fashion to the students as they arrived for class. Each packet 
contained the four measures arranged in random order. The course instructors notified their 
students that at a designated time in the following week they would be taking a computerized 
test in the computer laboratory instead of hearing a lecture. 

During the second and third weeks of the semester, two special computer rooms which 
shared a controllable box were designated for use by the course sections of this study in talcing 
a computerized test. The two groups (Motivated and Non-motivated) were randomly 
assigned by each course section. Three course sections were the motivated subject group, and 
the other three course sections were the non-motivated subject group. To control the effect of 
the test motivation, the non-motivated subject groups took the test first, followed by the 
motivated subject groups. 

As students arrived at' the computer laboratory for testing, they were randomly assigned to 
one of two groups (PPT first and CAT first), each meeting in a different room. The students 
were seated at one of 44 IBM 486 model microcomputers. Two algebra tests were given to 
each subject group in random order (PPT-CAT or CAT-PPT) in each room. The test 
administration procedures of each group were as follows: The group taking the PPT first were 
given the PFP test and the 10-item paper test anxiety scale, and then were given the CAT 
sample test of three example items. After completing the sample test, they took the main 
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CA.T and the 10-item computer test anxiety scale. The group taking CAT first were given the 
same tests in the opposite order. Finally, on completion of the two algebra tests and the two 
test anxiety scales, students were given a paper-and-pencil version of the Questionnaire on 
Computerized Adaptive Testing. 

Data Analysis 

The examinees' test-taking motivation (motivated, non-motivated) was the 
independent variable in a multivariate analysis of covariance (MANCOVA). There were six 
dependent variables of interest in this study: (a) two estimated algebra skills (PPT and CAT), 
(b) two test anxiety scores (PPT test anxiety and CAT test anxiety), and © two CAT attitudes 
scores (G-factor and S-factor). Tae covariates were the math aptitude and the test anxiety. 

Results 

Preliminary Analyses 

The linear relationships between the covariates (math aptitude and test anxiety) and 
the dependent variables (PPT algebra skills, CAT algebra skills, paper test anxiety, and 
computer test anxiety) were conducted by the multivariate test for significant regression. The 
results showed that there were significant relationships-Wilks' Lambda = .5130JF(2, 413) = 
196.02, p = .0001 for math aptitude and Wilks' Lambda = .8946JF(2, 413) = 24.33^p = 
.0001 for test anxiety. Thus, the results indicated that the covariates were related to 
dependent variables. 

The tests of the homogeneity of regression for the present data failed to yield significantJF 
ratios-Wilks' Lambda = .9899, JF(2, 203) = 1.03,4) “ .3577 for math aptitude by test 
motivation interaction and Wilks' Lambda = .9843,J(2, 203) = 1 . 62 ^ = .2005 for test 
anxiety by test motivation interaction. Thus, there was no significant interaction between the 
covariate (math aptitude) and the independent variable (test motivation); there was also no 
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significant interaction between the covariate (test anxiety) and the independent variable (test 
motivation). Therefore, the regression lines for each group were assumed to be parallel. 

To identify the base line for examinees' individual differences, which they had before the 
treatments were given, a series of t-tests were conducted by test motivation group. The results 
showed that the mean scores for the motivated group examinees and the non-motivated group 
examinees did not differ significantly in the major individual difference variables (math 
aptitude, computer literacy, and test anxiety;_p > .05) except for the computer anxietv 
variable (p < .05). 

Descriptive Statistics 

Means, standard deviations, reliability coefficients, and correlations for the main 
variables are presented in Table 1. 



Table 1 

Descriptive Statistics for Major Variables 



Variables 


M 


SD 


_r 


Variables 

12 3 4 


5 


6 


1 . Math Aptitude 


14.59 


3.01 


.74 


.45* -.05 


-.12 


.59* 


.63* 


2. Computer Literacy 


23.41 


4.98 


.80 


-.26* 


-.06 


.25* 


.37* 


3. Computer Anxiety 


23.68 


5.66 


.87 




.27* 


-.01 


-.05 


4. Test Anxiety 


38.46 


8.35 


.90 






-.06 


-.13 


5. PPT Algebra Skills 


1.81 


.96 


.62 








.54* 


6. CAT Algebra Sldlls 


1.79 


.77 


.74 











Note, r, reliabilities are alpha coefficients. PPT algebra skills were determined by a special 
data set and the conventional test scoring program (SCOREALL) of the MicroCAT testing 
system. CAT algebra skills were determined by the examination subsystem of the MicroCAT 
testing system. Reliability estimates for the PPT and the CAT were derived by subtracting the 
mean variance error of estimated ability from one (Urry, 1977) using both a fixed item (20 
items) and a .10 variance error termination rule. Variance errors for PPT were computed by a 
special computer program (Yoes, 1994). 

* The correlation coefficients over .14 are significant at the .05 level. 
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The mean and standard deviation for PPT algebra skills test were similar to those for 
CAT algebra skills test. Reliability estimates for the measures ranged from .62 for the PPT 
algebra skills test to .90 for the Test Anxiety Inventory. The algebra skill-related measures 
(math aptitude and algebra sldlls tests) were positively correlated, computer literacy and 
algebra skill-related measures were positively correlated, test anxiety and computer anxiety 
were positively correlated, and computer literacy and computer anxiety were negatively 
correlated. 

Group Differences 

Means and standard deviations for test motivation on estimated algebra skills, test anxiety, 
and CAT attitudes are presented in Table 2. 

Table 2 



means anu otanuaru ueviauuns ror csumatea /vip^eora cjkuis, 
and CAT Attitudes bv Test Motivation Grouns 


lest Anxietv. 










Variables 


Motivated 

(n=104) 

M m 


Non-Motivated 

(n=104) 

M SD 


Total 
(n=208) 
M 2D 


Algebra Skills 


PPT 


1.94 0.96 


1.68 0.95 


1.81 0.96 


CAT 


1.92 0.83 


1.67 0.68 


1.79 0.77 


Test Anxiety 


PPT 


11.36 2.32 


13.01 3.98 


12.37 3.31 


CAT 


13.76 4.28 


14.13 4.32 


13.74 4.31 


CAT Attitudes 


G- Factor 


33.32 3.96 


32.27 4.03 


32.80 4.02 


S-Factor 


26.04 5.30 


24.44 4.90 


25.24 5.15 



Group differences in estimated algebra skills . Group differences in estimated algebra 
skills were analyzed with a multivariate approach using a mixed-factor model. The one 
between-subjects factor was test motivation (motivated group and non-motivated group) and 
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the within-subjects factor was test method (PPT and CAT). The 2x2 multivariate repeated 
measures analysis of covariance, in which the covariate was math aptitude, revealed only one 
significant main effect for test motivation group (Wilks' Lambda = .9460,^(1, 205) = 1 1.69, 
p = .0008). Neither the test method main effect (Wilks' Lambda = .991 1 JF(1, 205) = 1.83, 
p = .1772) nor the test motivation group x test method interaction (Wilks' Lambda = .9999, 
F(l, 205) = .01,.p = .9390) was significant. 

Table 3 provides the univariate ANCOVA summary with repeated measures in estimated 
algebra skills. 

Table 3 



Univariate ANCOVA Summary for Estimated Algebra Skills 



Source 


df 


SS 


MS 


F 


P 


Covariate 
Math Aptituder* 


1 


1 14.89 


114.89 


246.82 


.0001 


Between Subjects 
Motivation (M) 


1 


6.72 


6.72 


11.69 


.0008 


Subject (M) 


205 


117.93 


.58 






Within Subjects 
Test Method (T) 


1 


.65 


.65 


1.83 


.1772 


MxT 


1 


.01 


.01 


.01 


.9390 


T X Subject(M) 


206 


73.40 


.36 







Note: Based on pooled error term / dfj(M) + df-r-^jM) = -47. 

As can be seen in Table 3, the results indicated significant differences for the test 
motivation group (F(l, 205) = 1 1.69,4) “ -0C8) and covariate (math aptitude). The test 
method and test method x test motivation interaction indicated no significant differences. 
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Motivated group examinees had higher estimated ability than did non-motivated group 
examinees. There was no significant difference between PPT and CAT in estimated ability. 

Group differences in test anxiety . Group differences in test anxiety were analyzed with 
a multivariate analysis of a mixed-factor model. The one between-subjects factor was test 
m.otivation (motivated group and non-motivated group) and the within-subjects factor was 
test method (PPT and CAT). The 2x2 multivariate repeated measures analysis of 
covariance, in which the covariate was general test anxiety, revealed only one significant main 
effect for the test motivation group (Wilks' Lambda = .9714,_F(1, 205) = 6.02,_p = .0149). 
There were no significant differences in test method main effect (Wilks' Lambda = .9973, 

F(l, 205) = .55,^ = .4600) or in the test motivation group x anxiety type interaction (Wilks' 
Lambda = .9962, F(l, 205) = .79,^ = .3759). 

Table 4 provides the univariate ANCOVA summary with repeated measures in test 
anxiety. 

Table 4 



Univariate ANCOVA Summary for Test Anxiety 



Source 


df 


ss 


MS 


F 


p 


Covariate 
Test Anxiet)'* 


1 


438.74 


438.74 


32.44 


.0001 


Between Subjects 
Motivation (M) 


1 


1 1 1.85 


111.85 


6.02 


.0149 


Subject (M) 


205 


3806.43 


18.57 






Within Subjects 
Test Method (T) 


1 


4.68 


4.68 


.55 


.4600 


MxT 


1 


6.75 


6.75 


.79 


.3759 


T X Subject(M) 


206 


1751.50 


8.50 






Note: Based on 


pooled error term Sl^o„ 


Error 
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As can be seen in Table 4, the results indicated significant differences for the test 
motivation group (T(l, 205) = 6.02, jp = .0149) and the covariate (general test anxiety). 
There were no significant differences in test method and in the test method x test motivation 
interaction. Non-motivated group examinees had higher test anxiety scores than did 
motivated group counterparts. There were no significant differences between the CAT and 
the PPT test method based on test anxiety. 

Group differences in attitudes toward computerized adaptive testing . Group 
differences in attitudes toward computerized adaptive testing were analyzed using a one-way 
multivariate analysis of variance (MANOVA). The test motivation was an independent 
variable and two factors of the attitudes toward CAT were dependent variables. The 
MANOVA indicated non-significant main effects for the test motivation group (Wilks' 
Lambda = .9723, F(2, 202) = 2 . 88 , 4 ) = .058). 

Motivated group examinees had more positive attitudes toward CAT than did their 
non-motivated counterparts, but did not result in a statistically significant difference. The 
results indicated that test motivation group examinees had similar attitudes toward CAT. 

Discussion 

The purpose of the study was to investigate the effects of test motivation on estimated 
ability, test anxiety, and attitudes toward computerized adaptive testing for Korean college 
students. Motivated examinees had higher mean ability estimates than non-motivated 
examinees in this study. The results found that test motivation affected the facilitation of 
algebra skills estimates significantly. The present results arc consistent with findings from 
previous studies that investigated motivational effects on paper-and-pencil test scores (Brown 
&. Walberg, 1993; Wolf, et al., 1994). Non-motivated examinees had higher test anxietv 
O 
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levels than did their motivated counterparts. Although motivated examinees had higher 
computer anxiety levels than non-motivated examinees before the treatments were given, the 
results showed that test motivation affected the reduction of examinees' test anxiety. 

There is at least one possible explanation for this result. Motivated examinees had 
higher scores than did non-motivated examinees, in the current study and in previous studies 
(Brown & Walberg, 1993; Wolf, 1993). Motivated examinees might have experienced a 
higher level of initial success on the tests than did non-motivated counterparts. It was found 
that test anxiety increased in students who experienced initial failure in a testing context, 
while test anxiety decreased in students who experienced initial success (Bradshaw &. Gaudry, 
1968; McMillan, 1980; Mevarech ScBen-Artzi, 1987). Perhaps this initial success may make 
motivated examinees feel comfortable and more responsive to positive statements. 

There was no significant difference between motivated examinees and non-motivated 
examinees in attitudes toward CAT. The present finding is not consistent with previous CAT 
research in which examinees generally preferred computerized testing formats (Gershon £k 
Bergstrom, 1991; Legg ScBuhr, 1992; Moe &. Johnson, 1988; Schmitt, et al., 1978; Vispoel & 
Coffman, 1992). 

The current data show that test motivation was related to an improvement in 
examinees' estimated ability and a reduction in test anxiety. These findings provide empirical 
evidence that the effects of test motivation on test performance and test anxiety appear in 
CAT as well as in PPT. 

The present results have useful practical implications for educators and researchers. 

First, test motivation is one of the important factors which explains U.S. students' poor 
performance on achievement relative to students in other countries (Brown ScWalberg, 

1993). The Korean students' exceptional math performance in international comparison 
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studies is attributable to their higher motivation (Wainer, 1993) or more time spent doing 
math homework (Lapointe, Mead, &. Phillips, 1989). Moon, Byun, McLean, and Kaufman 
(1994) found that Korean children's math strength may have influenced their exceptional 
ability to remember numbers rather than vice versa. Also, they suggest that higher motivation 
may have influenced their high math achievement even more so than their outstanding 
sequential processing. 

Second, the present data provide an explanation of the relationship between test 
motivation and test anxiety. These motivational effects on test anxiety might have a practical 
implication for educators. Highly motivated test instructions might contribute to reducing 
examinees' test anxiety rather than to increasing it. Thus, educators must know how to use 
motivated test instructions for their classroom tests. 

Finally, this study is one of the first attempts at using non-English speaking subjects in 
CAT research and provides an empirical foundation for further cross-cultural studies in CAT. 

The study was limited in the following areas. This study did not measure the degree of 
examinees' initial success or their satisfaction with test results after taking a test. To explain 
the relationship between test motivation and test anxiety systematically, further research 
should be considered concerning the measurement of the examinees' initial success on test 
scores. In this study, the levels of examinees' test motivation were not measured before or 
after test instructions were given. A procedure to measure examinee test motivation should be 
developed to assess the more genuine effects of test motivation on test performance, test 
anxiety, and attitudes. Further international comparison studies are needed that control the 
effects of test motivation on test performance, using examinees' test motivation measures. 
Moreover, further CAT research should be focused on how to enhance students' motivation 
not only in tests, but also in classroom learning and instruction. 
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